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Column 4. Line 43 to Column 5. Line 38 

[0016] 

[Embodiments] A characteristic of the present invention substitutes a visual line, and a 
voice and a visual line as inputs by a mouse and a keyboard which have been inputs to 
a computer. More specifically, with respect to a voice input, the present invention has 
a voice processing means that recognizes and processes a voice, and converts the 
generated voice to an input signal of a computer (an information processing means). 
[0017] In addition, the present invention provides a means and a device for inputting 
information to a computer by using a visual line, including: a visual line detecting 
means that detects a visual line position directed to a display to collect information of a 
moving distance, moving speed, a gazing time, a pupil diameter, the number of times of 
blinks, and an interval of blinks; and a control processing means that controls display 
on the display (a display means), the means and the device for inputting information to 
a computer by using a visual line that detects a position of a visual line to use such 
position for instructing a position on the display, and further measures a time length (a 
blink interval) between blinks and the number of times of blinks to correspond the 
above input to the instructed position to selection, execution, or drag of a command. 
[0018] The present invention is different from a conventional technique with respect to 
a point that the present invention enables input to a computer by a visual line and a 
voice of the user, instead of an inputting means that the user of a computer has carried 
out by using a mouse and a keyboard in the conventional technique. 
[0019] FIG. 1 shows a configuration example of an information input device using the 
present invention. The present invention includes an input processing and display 
control means 2, an information processing means 3, a display means 4 (hereinafter 
referred to as a display) for a computer, a visual line information detecting means 5, 
and a voice processing means 6 which is a target of information input. 
[0020] A visual line is not used as an inputting means in operation with respect to 
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keyboard input and mouse input which are conventional information inputting method of 
a computer. In addition, a voice is also not used as a conventional information 
inputting means of a computer in many cases. The visual line information detecting 
means 5 measures a visual line position, a moving distance, moving speed, gazing 
time, a pupil diameter, the number of times of blinks, and an interval of blinks as visual 
line information. In addition, the input processing and display control means 2 uses 
the visual line position, the moving distance, the moving speed, the gazing time, the 
pupil diameter, the number of times of blinks, and the interval of blinks to determine a 
position of a pointer, whether a pointer is in a moving state, or whether any of selection, 
execution, and drag is carried out as input of a computer. The voice processing 
means 6 that uses a voice as input recognizes a voice and converts the recognized 
voice to an input signal, and in this manner enables voice input to a computer. In the 
above manner, input to a computer is made possible even in a state where the user 
cannot use own hand. In addition, by using voice input in addition to visual input, 
fatigue caused by when only visual input is used can be reduced. 
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(54) INFORMATION INPUT METHOD AND DEVICE THEREFOR 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an information input method 
for substituting manual input by using the line of sight as an 
information input means for a computer by detecting and displaying a 
line-of-sight position on a display and turning information determined 
corresponding to the line-of-sight position and the movement of the 
f line of the sight, to the input signals to the computer. 
J SOLUTION: The line-of-sight position on the display is detected, the 
detected line-of-sight position is displayed on the display and the 
information determined corresponding to the line-of-sight position 
and the movement of the line of the sight is turned to the input signals 
to the computer. For instance, this device is composed of an input 
processing and display control means 2, an information processing 
means 3, a display means (display) 4, a line-of-sight information 
detection means 5 and a voice processing means 6. Then, the 
line-of-sight information detection means 5 is composed of an optical system device, a video camera and a 
mirror, reflects infrared rays sent out from the optical system device to the pupil of a computer user by the 
mirror installed by the display 4 and fetches the reflected light to the optical system device again. 
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£. -gF7^*5h?c7-/3>B. m^ea^ftrier 

n yttftvmWrV . $ /c ? £ «W L< ft: £ £ (C K 7 

ft#c.^^$n-5, *>©£ i (20) , ( 2 i ) . -e-n 
r4/j$i£;*ftsa>4>©£T-5. io 

[0 044] C<Di^WI5rt5C£T. K^y^L 
[0 045 ] Yv -j V^mmc^XkZm'&Ltc 

iifrw o a £ * (cm;gits$g <t o -c k?ls© -r - * tmti 

0m strFr*£t§^£. *lifctlfci«»it5„ 
[0 04 6] CCi^^^OSo-Cl^cD-C. =J>f 

CD A*8ST* -5 -7 V X ©ftft 0 (CfjU§W5<s£ffl-C 20 
#£©r, ^£&ftfc<T4>A**n?i*£«i: i 5(Cft£. 

it/tB, n > k> - £ © A^Jffi**5!^(c^>^ 

f g©«j t a a — »f tmm -re » c t wwr % 

ft*. 

[0047] immm 2] i6«, 2©njt 
PK^iftwrss-rAor. mMM Kom^ctt^. urn. 
tcJzZtJj&mMm l ©£5&fi£5ft©-^;*A*©tt# 

£l,-Cfc&5C£-e*0. C©^«#^A7J«'fTft& 30 

T^4*A*tt«!*>fclr». ^A^4i»iT'C3> ; &^lft 

T. ibt 8U8©&a £ Mffi©{iH=&— Be 3 -fcf 

U/c»*»f (5*BFf4>b<«9*3T) ©{iS* 
■ffl-k©*inK:ffit». ttffl*A*»ao. tM804*tt%» 

[0 048! HRg©3>b'i-JfX^J(C^-rStI 

ai©ii5aft*H*6-r*. moLktctt. ka#**j 

( a > ©ttJSa* 6 ( b ) ©<fc^(C + — rK— h'iimm^K. 
gift*. c©@iffi*-tf- K±co-t-*ftI«:j:^ra 
«-r-sc£-c. ka*£ oisetc -r s. c©t§£- 

tt. «6*©l».»:J$Fr***-*K- h'^l*©.h«Cf§?ra^ 
rA*raH:ft«5CC. tJUHfciBIT±<D*-H*- K©+- 

©±tca< c£r»fi6*Ht»-r«». ««kcj:s*-#- so 
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[ 0 0 4 9 ] m 7 KflLK**-**- K««©rt»A* £ 
(3 1) - (3 7) liS^r j7'^f„ n>t.a-£ 

ttmfcr a £. sia**tc^Y > 3»*s«to f tti»A*ieKi 
r -f 3 3 n s . mmA^iisbr ^a>t>'jj 

?-<f-3£ (31). sP-f>i»±0««OiR**H!*6-r 
-5. it, t&E£'fT-5 (3 2) . «jE*M*7-r*£A# 
Nftt©#*TtcA4. m##±LTt>S#>&16L 
r^-5*^«'iS-r^. (33). SffciSJg ($MfcB*lfll*fc. 
9 ©*?»iftl£) vld5Ltl»ffia J:0/h$t»£ (3 
4) . *<0fiUB«:tMi36J»±tt»-r*5<>O£*l3SU. 
L*l>«aJ:0**t,>i»l#!l'Cft5ittrf4 <3 
7) . (No©*^) TB. «5EB#WMH4-C. 

iv^ttreii^aiu&i- sc £«cj: fj&a^iJi 

fctf?. — #±tt» (Yes ©# ft) r«. JfctC* 

«/c * * o ^ ^ * a . . * « fc * * o fctft* 

(Ye s©*^]) ^OfiatC*53V> F^rHtfT 
a (3 5) . (3 6) . -7?. *tffc**ly«:*^/cfll 

^ (Noo^> «. ss. uur&s. mmm, m?l 
©«ie« i n©^£-ra. 

[0050] c©i^fe»it(c%ort,>a*>6. Ji^f* 

ft-T. 1 ©*§o-J: 0 iSSX^^^A^r* a 

- X ©Mfi* 5 ^ ft C > C £ # W 6 ft . 

[0 0 5 1 ] CIOt«3) H8tt**W©Slt3©iefeff( 

K 1 A»S^©«C^£l5]«f. f|(c«fcSA^£ 

u ^^^©^©^w^tcitj^Mf-rs. c©«t5a 
it it «: a o -c c > a *^ <=> . *© 3 > f i - $ nm cc *j w 

5vf ^J»lfi*lJt»-CR»-r a C £ (C «t 0 . *- K 
£ v ^ 7v £ (, » 5 fi£*<Kftftr 1*2 mmOAft&Sfr h 
FA*©*. *£©A*«»«tcJ: 
0 A* £ t » "5 «t -5 CC . fgfcfcflil » fcA^iSa* 
■c**. ^©?Am£ur«. A**S^©fffi^ft. ^-1f 
©A*«s*«ffl(cffl-r afflJiS #« 6©gB8c^*S. 
[0 0 5 2 ] I9«, *I6^©^4©HSS 

lW*SSiWr«ia-C*o-C. 1 B BA*#S© "5 % ©"^ $ 
7. 2-4, 6»I1 ©HJSS0II£|dII;-C*>-2). 
BttSet£©«U»75r£ISia-C. *g(Cj:5A*j£U +->f- 

- K ©«ffi©*#]«CC <fc 0 f a. C © J: ^ QcWjBCC 
Aj: -o r L » a 6 . Kf-Jft©3 > f - d> ffSHtc fcW a * - 
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* 1 1> ^ 6£*fletotir 2 aa©A*aaE*»6*B 

iconic. fSjfe*fflt»fcA*4at* 1 ftatc-c* 
■S. *©»*iOr«. A*«*OIPI*fk. a— !f©A 

[0 0 5 3 ] #R\*B§(c*6#>0&ffi&Sft-O»5=> 
vvKiiTB, 7 T J hWrnc-imti rtgMj . rgiJ 

fiMBJI(c.iJ*tt ta*jj . r«»j . r 3 f-j, io 
-*hj, r?B*j . ra&.fcsjtj ii,^fc3v> F 
cn603-v>F(co^r«. ^r^t?. 

i=i-7> F4Htf-C#-5. 

[0 0 5 4] »*A2JtC «fc ^^^^©A^CC«. 
rAAJ 37>Ftll>4. rA^)J =f7> F#30t3 

n-si. m>T2gjps3tt£&©a*^*&c^;i:^A;ft 

[0 0 5 5] .20 

[ ¥ZW<r>n3k ] feLhSMH b tc <fc 5 tt . (c «fc 4 «« 

A?J2h£fc <fc Cf SBKtc <£ 9 «fc V ^ > f ^ - 
^^©A^J* S °I#B"C , *)4* 1 6. 3>Kj- £©J—1f -f- 

>*7*-^*»«fc»)sa(ctt»j. A*»5R©n>»fb*«ia 

htx. WiLJ«Btcp»#*^oA^»#l«Wr*te**)OA 
-C *> + - * F *<DWEU LJC 3 > f a - $ ©f* 

[0 0 5 6] Sfc. flUM** 
ll^*«fliL-Cl>4CD-C. tft«tS*arcW{C «fc SA^T 

«. *%c^«iLr«i0f*7n-r©«w«i-c*4*s. £ 30 

X£.t. *W»*fc*Wlc<t4A*r»*. ^^^©il 
^A^{C«WJ»-C*SA». *Bfr*Jifflrt> < ^©{C^Fil. 

[0 0 5 7] £/c. #^CCj:5A^/cW-C«t8BT*lffl3!P 
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fr-afctf. t^A2j*flWHT setter, sskhss 

[0 05 8] je>(C ffl«A^*iWCB. S^SP?* 
ffiiiSi© * - sK- F *» 5 A#T S KKC fflfr t 1 tSBFf ©?£«> 
•'fc^* C £ (C J: 6 X^-fft^© 

A*©ISK*i»A^*fltffl'r4 CitcJ:^ "OSi**®* 

[0ffi©l8MJi&i&BJ] 

[0 1 ] **Wtc*>*>5tt«A^»i8K©— *tt«<7>1«fiS 
[^ 2] 0 1 ©^Jfctajrffli-^Bffiitcji^ti^j* 

*5 J: vw.mxt>m<DmMT a ^ >fc<t^77 ^ >© 

[0 3] *«Wtc*»*»*««A^3*tt©— WS««r8iW 
nfcftO7 0-ft- 

[04] tt&W tc*>a9» StlMIL\**i* ©— £i&BJ3 
■T4fcJt)©7 n-?- - h r;&5. 
[05] *&9J *tt«Afc*i£©— £8&bj 

[06] *^(c*sC>-C®ffi±^e.*-#- FA^^tT 

[0 7] *^tC*»*>St»«A**^©flfe©3aS«*ltt 

bjt 6fc*©7 d - ^ + - h r* s 

[0 8] ^B^ic^A^tflSA^^fte©*^©* 
fi££/Kf 'T'n ? ^0-C*£„ 

[0 9] *^cc^^5t**gA*#lS©^e.4Cffe©jWfe 

[010] S£*©:n>£*-£©«a^*7n0/c:/a 
^0T$>4. 
[^©3i^] 

1 A*3*J£ 

2 A*^a*J«fcO'*^»#l3 

3 \mwm^WL 
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5 m^t»«^m^ia 

6 mmmm^m 
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